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TO DETERMINE HOW EFFECTIVELY THE COOPERATIVE ENGLISH 
TEST PREDICTS STUDENT SUCCESS IN FRESHMAN ENGLISH AT STOCKTON 
COLLEGE. THIS STUDY WAS CONDUCTED (1) TO OBTAIN STATISTICAL 
COMPARISONS BETWEEN FINAL SEMESTER GRADES OF A SAMPLE OF THE 
COLLEGE TRANSFER POPULATION WITH THE WHOLE TEST AND EACH OF 
ITS FARTS. (2) TO ANALYZE BY PERCENTAGES THE PROPORTION OF 
STUDENTS WHO EARNED VARIOUS GRADES. ACCORDING TO THEIR 
RELATIVE PLACEMENT ON THE TEST AND ITS PARTS. (3) TO ANALYZE 
THE REASONS FOR FAILURE. AND (4) TO DETERMINE THE PROPORTION 
AND AMOUNT OF SUCCESS OF THOSE WHO WERE GIVEN SPECIAL 
PERMISSION TO TAKE THE COLLEGE TRANSFER COURSE WITH A SCORE 
less than THE NORMALLY REQUIRED 159. DISTRIBUTIONS COMPARING 
TEST SCORES AND FINAL GRADES ARE PRESENTED GRAPHICALLY. 
ANALYSES OF PREDICTIVE QUALITIES BY MEANS OF THE PEARSON 
PRODUCT -MOMENT COEFFICIENT OF CORRELATION AS WELL AS 
SQUARE AND PHI COEFFICIENT TESTS SUGGEST THAT THE CLOSEST 
RELATIONSHIP IS BETWEEN THE STUDENT’S FINAL GRADES AND THE 
MECHANICS FART OF THE TEST. THE VOCABULARY. EFFECTIVENESS. 

AND SPEED SECTIONS OF THE TEST AS WELL AS THE FINAL GRADES uF 
STUDENTS WHO TOOK THE COURSE WITH SPECIAL PERMISSION SEEM TO 
INDICATE NO APPARENT RELATIONSHIP BETWEEN TEST SCORES AND 
FINAL SEMESTER GRADES. ADDITIONAL INFORMATION FROM 
questionnaires reveals THAT TEACHERS CONSIDER EXCESSIVE. 
UNEXCUSED ABSENCES AS THE MAJOR CAUSE OF STUDENT FAILURE. 
THEREFORE. THE AUTHORS QUESTION THE ADVISABILITY OF USING 
OTHER THAN THE MECHANICS FART OF THE TEST FOR PLACEMENT IN 
THE FRESHMAN ENGLISH COURSE. (AUTHOR/BN) 
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lo STATEMENT OF THE PROBLEM 

Achieving a »»Total of Scaled Scores" of at least 1^0 on the Cooperative 
English Test, Form RX, Higher Level, 19h9f has been necessary for several years 
at Stockton College for a student to be permitted to register for the "college 
transfer" Freshman English composition course. Until then, he is assigned 
either to a remedial composition course or to a reading course or both* 

The purpose of this study, then, is to discover how effective this Coop- 
erative English Test and its several parts are in predicting the amount of 
success a student may achieve in Freshman English. 

The method of determining an answer to these questions was: (l) to obtain 

statistical comparisons between final semester grades of a sample of the college 
transfer population with the whole test and each of its parts, (2) to analyze 
by percentages the proportion of students who earned various grades, according 
to their relative placement on the test and its parts, (3) to analyze the reasons 
for faiiure of those who failed, and (li) to determine the proportion and amount 
of success of those who were given special permission to take the college transfer 

course in spite of the fact that their score was less then the normally required 

1 ^ 0 . 

The sample chosen for this study includes 21^ students, all but 17 of whom 
qualified for the college-tranefer course, English lA and 1A71,* when taking the 
Cooperative English Test as a part of the entrance testing program of Stockton 
College. 



♦English lA meets three hours a week for three units of credit, while English 1A71 
meets five hours a week for four units of credit, one unit of which is laboratory and 
is normally not accepted for transfer to upper-division schools. Obviously 1A71 
is designed to permit additional instructor attention to this less capable group. 
These two courses will be referred to separately throughout the rest of this paper 
as above, or together as English 1A.-1A71. 
o 





These remaining 198 were all who took and passed (a score of 1^0 or better) 
the entrance examination for Fall Semester, 19^8 and enrolled in English 1A-1A71 
for Fall 19^8, with the exception of students in one section out of thirteen, 
which was inadvertently excluded* All of the rest of the students in English lA- 
1A71 during Fall 19^8 either qualified by way of boosting their score as a result 
of taking one or more remedial courses, or qualifed earlier than Fall 19^8 by 
their entrance examination* These are NOT included in the sample. 
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2o PROCEDUltE 

2«1 Procurement of the raw data 

The Stockton College IBM office furnished a complete set if IBM cards 
punched with the name and final grade of each student in all sections of 
English U-1A71 for Fall 1958. A separate set of IBM cards was available with 
the Fall 1958 entrance test scores, including sub-scores on each of the five parts 

of the Cooperative English Test: Total, Mechanics, Effectiveness, Vocabulary, 
Level, and Speed* 

Prom the appropriate cards of these two sets, there was prepared a 
third set, the sample for this study. It includes all those students eligible 
for 1A-1A71 on the basis of their entrance tests plus the few rtio registered in 
1A71 by special permission or error. 



2,2 Treatment of the data 

2.21 Scattergrams of group scores and grades were prepared and 

coefficients of correlation were obtained. The formula used is a variation of 

the Pearson product-moment formula, which assumes homoscedasticity of the row 

and column arrays, and assumes a mean of zero during the early part of the 
manipulation® 

An attempt at further analysis of predictive qualities was made by 
means of chi square and phi coefficient tests of the data derived from the Mechanics 



^ince the raw scores on the "Level'* section range from 9 to 86. but are 

^ ^ ^ person who completed only one-third of 

ohe rea^ng may result in a higher standard score than a higher raw score for a 

ILustTcllt^^^ Because this complicated the 

study ^ ^ treatment, analysis of the »»Level*» section was eliminated from this 



I !■ 



o 

ERIC 



k 



part of the Cooperative English Test. The Mechanics test was selected for further 
analysis because it appeared as relatively the best instrument on the basis of 
criteria previously applied in the study. 

In order to do the grouping required for such tests, division points 
were selected as follows: 

1. Scaled score of ^0 — the point which is approximately 0.6 of one 
standard deviation below the mean score (5^«7), according to 
cooperative test published norms for entering freshmen at four- 
year liberal arts colleges. This point would represent the 
beginning of the "C** grade range if one were **grading on the 
curve." 

2. Scaled score of 6l — the point which is approximately 0.6 of one 
standard deviation above the mean score described in item 1 and 
which would correspond to a letter grade of "B" in the norm 
group. 

Scaled score oi 72~the point which is approximately 1.8 
standard deviations above the mean described in item 1 and 
which would correspond to a letter grade of "A." 



2.22 Graphs were constructed to cor^are semester grades with the Total 
of Scaled Scores and with the raw score of each part of the Cooperative English 
Test. The three intervals on these graphs were chosen so that the second interval 
in each table represented the normal range for English 1A71; the three intervals 
for Figure I are by definition as follows: 

a. Top, 16 ^- 2 ^ 14 — those eligible for English lA 

b. Middle, l50-l61;~those eligible for 1A71 

c. Special, 13^-1149 — those admitted to 1A71 by special permission 
For the other tables, the intervals are approximations of the range covered by 
English lA, 1A71, and specials. These approximations are necessary because a 
student ^s Mechanics score, (l/3 of the Total of Scaled Scores of l^O) necessary for 
1A71, might have been less than ^0, although his other scores were enough higher 

to offset it and still make him eligible for 1A?1. The first interval is made 

UD of all those who fall below the second interval j and the third interval (English lA) 

of all those who fall above the 1A71 range,, 

o 
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2^23 A separate analysis was made of those students in the course with 
a Total of Scaled Scores below 1^0. Although at first these people seemed to 
contaminate the study somewhat, their presence does add some information regarding 
what happens to those who score lower on the entrance test# The following data 
were collecteds the previous college English course taken, if anyj grade earned 
in the previous course; and grade earned in English 1A71« 

2#2U Failures were analyzed by having both the teacher of the English 
course and the student’s counselor describe why they thought the student failed# 
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RESULTS 



3,1 Statistical measures of the relationships between final semester grades 
t^th both the total and various parts of the Cooperative English Test were sought 
by the study. How effectively does the Cooperative English Test enable one to 
predict the amount of success a student will have in English 1A-1A71? Table I 
attempts ?. study of the relationship between final semester grades with the whole 
Cooperative English Test and its parts. There were 21^ students represented in 
each study of relationship. 

TABLE I 

CORRELATION BET^aTEEN THE FINAL SEMESTER GRADES 

and the 

COOPERATIVE ENGLISH TEST AND ITS PARTS 





Total of 


Mecnanics 


Vocabulary 


Effectiveness 


Speed 




Scaled 


Raw 


Raw 


Raw 


Raw 




Scores 


Score 


Score 


Score 


Score 


Final 

Grades 

(ABGDF) 


.31 ± .06 


, 1|0 ± «06 


.23 ± .07 


.20 ± .07 


.00 ± .07 


N^21^ 













Examination of the coefficients of correlation in Table I indicates that 
several of the sections of the Cooperative English Test (Speed, Vocabulary, and 
Effectiveness) had practically no correlation with semester grades and that one 
part. Mechanics, had a higher coefficient of correlation than the total test. 



3«11 Chi square and phi test 

How effectively does the Mechanics part of the Cooperative 
English Test predict success in English 1A-1A71 as measured by final semester 
grades? ^ 

TABLE II 

PREDICTIVE CKARACTERISTICS 
OF THE 

MECHANICS PART OF THE COOPERATIVE ENGLISH TEST IN 
TERMS OF EARNED SEMESTER GRADES 
N-215 



Division 

by 

Grades 


Division 

by 

Scaled Score 


No. 

Correct 

Prediction 


No. 

Incorrect 

Prediction 


Percent 

Correct 

Prediction 


X2 


0 


ABC 


>5o 


131 


17 


0.88 


5.3 


0.16 


DF 


<50 


16 


51 


0.23 


5.3 


0.16 


AB 


>61 


la 


13 


0.76 


26.6 


0.35 


CDF 


<6l 


lOk 


57 


0.65 


26.6 


0.35 


A 


>72 


k 


6 


o.ho 


8.7 


0.20 


BCDF 


^72 


189 


16 


0.92 


8.7 


0.20 



The data *n Table II indicate that the odds are in favor of correct 
prediction for all groups excepting ^^0 and Chi squares indicate that the 

difference in the two score groups in each division tests well in respect to signi- 
ficance. The difference in Division I is significant at between the 0.02 and O.Ol 
level and in Divisions II and III at above the 0.01 level. Phi coefficients range 
from 0.l6 to 0.3^. As measures of validity, the obtained coefficients describe 
acceptable standards. 

On the basis of the criteria applied, the Mechanics test would 
appear to do a reasonably acceptable job of predicting placement in all categories, 
except equal to or less than 50 and greater than 72. In Group I, there appears 
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to be some limitation in the size of the sample for this division (equal to 
or less than ^O). However, there is an indication that there might be a fairly 
good chance for people who were excluded at this point to succeed in the course. 
Therefore, all other available data should certainly be given careful consideration 
and provision should be made for reasonable latitude in judgement in the matter 
of selection. 
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3«2 How well does the Cooperative English Test and its parts serve as a 
segregating instrument to keep out those likely to fail or do poorly in English 1A71? 
To present this information visually, the following graphs were constructed: 



3.21 The Total of Scaled Scores 



Figure I shows the comparison on the basis of the Total of Scaled 
Scores with final semester grades. 



FIGURE T 



COMPARISON OF TOTAL SCALED SCORE ON COOPSIATTVE ENGLISH TEST 

WITH SEMESTHl ®ADES 
N*213 




Before examining the results, let the reader be reminded the 13^-Hi9 
interval includes only those who took English 1A71 by speciax permission or error. 
Interval l50-l6U includes only those eligible for English 1A71. The higher interval, 
then, includes only those eligible for English lA. Examination of the "F", "D", "C**^ 
grades reveals a somewhat noticeable smaller proportion of these grades as one 
proceeds from the lowest to the highest interval. Likewise, there is a somewhat 
rising proportion of and '♦A” grades from the lowest to the highest interval#. 
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3o22 Mechanics 



Figure H shows the coirqjarison of the semester grades with one 
part of the Cooperative English Test, Mechanics. 



FIGURE II 



COMPARISON OF MECHANICS RAW SCORE 

on 

COOPERATIVE ENGLISH TEST WITH SEMESTER GRADES 

1^212 




Examination of this table reveals an even more pronounced "flow® 
than for the Total of Scaled Scores of Table II« The "F*s" and "D»s" and "C*s" 
decrease from the lowest to the highest interval. The "B»s" and "A*s" increase 
from the lowest to the highest interval. One would expect this trend to be more 
pronounced for Mechanics than for Total of Scaled Scores since the coefficient of 
correlation for Mechanics is higher. 





3«23 Vocabulary- 



Figure III shows the comparison of semester grades with the raw 
scores of the vocabulai^ section of the Cooperative English Test* 

FIGURE III 
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3*2li Effectiveness 

Figure IV shows the comparison of semester grades with the raw 
scores on the Effectiveness section of the Cooperative English Test* 

FIGURE IV 

COMPARISON OF EFFECTIVENESS RAW SCORE ON COOPERATIVE ENGLISH TEST 

WITH SEMESTER GRADES 
N=213 





Effectiveness 


SEMESTER GRADES RECEIVED 


TOTAL 
N i 


Per cent 
of 

Sample 


IIRW 

Score 


N ^ 


N " % 


}i ^ % 


N ® 


N * ? 


1 


2 


3 


h 




6 


7 


8 


u 

(1)2-59) 


^I) 1).0« 


30 8.9^ 


29.8?] 


Ui.l)? 


1 

[13 12.9? 

' 


101 lOOJg 


h7.h% 


1A71 

(36-la) 


1 

7 9.7« 


1 

1 6 8.3? 


wm 

31) 1)7.3? 


1 20 27.85g 


^.9% 


72 lOOjK 


33.8? 


Special 
(27-35) 1 


[3 7.5«| 


i 

1 1) 10.0? 


1 19 1)7.5?] 


fa 1 

1 12 30.0^1 


\ 2 5.0? 


UO 100^ 


18.8? 



An examination of the table reveals that there is a slight but 
perceptible grouping of "F", «D»* and »C" grades in the lower two intervals ar.d 
likewise a slight but perceptible grouping of "B** and "A** grades in the highest 



interval* 
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3o 25 Speed 

Figure V shews the comparison of the semester grades with the raw 
scores on the Speed section of the Cooperative English Testo 



FIGURE V 



COMPARISON OF SPEED RAW SCORE ON COOPERATIVE ENGLISH TEST 

WITH SEMESTER GRADES 

N=215 



Speed 

Raw 

Score 


SEMESTER GRADES RECEIVED 1 


TOTAL 

|n * 


Per cent 
of 

Sample 


^ % 


N ^ f 


N * 


N ^ % 


N * *1 


1 


1 2 


3 


h 




6 


7 


8 


lA 

(2h-77) 


1 

|6 8„15g 


■ 

13 17.3* 


23 30.6*1 


■ 

|25 33.3* 


1 

8 10.7* 


75 100* 


2hM 


U71 1 

(12-23) 


1 

U h.2% 


1 

2 2ol5^ 


■i 

ii3 U5.li* 


■ 

39 Ul.O* 


f 

7 7.3* 


9^ 1005^ 


T 

UU.3* 


Special | 
(0-11) 


E 8.9^1 


S 8o9^ 


■ . I 

Il8 liOoO^I 


■ 

llU 31.1*1 


5 11.1*1 


\kS 100% 


20.9* 



An examination of Figure V shows that there is no apparent 
relationship between semester grades and scores on the speed section of the 
Cooperative English Testo 
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3.26 Scores Below 1^0 

Some additional information was gatheied about the seventeen 
students who took English 1A71 who did not qualify on the basis of the Total 
of Scaled Scores of 1^0 but who took the course anyway, presumably by special 
permis'jiono Table III gives this information. 

TABLE HI 

THE SEVENTEEN STUDENTS WHO TOOK ENGLISH 1A71 
WITH A COOPERATIVE ENGLISH TEST SCORE OF lESS THAN 1^0 



Total 


Grade 


of 

Scaled Scores 


Earned 


1U9 


B 


1U9 


C+ 


1U9 


C 


lUo 


C 


1U9 


D- 


lli 8 


B 


1 U 8 


D- 


1U7 


B 


1U7 


F 


II 46 


B 


IU 6 


c- 


1 U 3 


A 


lUl 


C 


iia 


C 


136 


F 


13 U 


B 


111 


C 



Remarks 



Took English 7U, Fall 195>7. Earned a "C**. 



Eirroneously enrolled in 1A71 &nd not dis- 
covered until too late to change. 

Previously completed two quarters of college- 
transfer English composition with grades of **D'* 
at another collegiate institution. 

Previously completed two semesters of English 
73 with a grade of at Stockton College, 



An examination of this information seems to indicate no apparent 

relationship between final semester grades and the Cooperative English Test. 

o 
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3«27 Failures 



An investigation was made into the purported reason for failure 
of the fourteen students who failed English 1A-1A71« Table IV provides this 
informationo 



TABLE IV 



REASONS FOR FAILURE GIVEN BY COUNSELORS AND INSTRUCTORS 

for the 

FOURTEEN WHO FAILED 



Total 

of 

Scaled Scores 


Reason Given 
by 

Counselor 


Reason Given 
by 

Instructor 


213 


Perfectionist; unable 
to budget time well 


Much ability, no con- 
fidence, Does not meet 
deadlines • 


185 


Disorganized and aca- 
demically unstable. 


Did little work and that 
carelessly; no term 
paper 


173 


Working on chemistry 
instead; no time for 
term paper 


No term paper 


l61i 


Lack of interest and 
effort. 


Excessive unexcused 
obsences . 


163 


Job for I 4 O hours a week; 
lli units besides 


Did little work; no 
term paper or compo- 
sitions. 


162 


Left school to get 
married; Reading score: 
li 8 ; also took Eng, 75. 


Excessive unexcused 
absences . 


l 6 l 


Not interested 


Did almost nothing 


158 


1 ^ units; his only F; 
has only one eye 


Primarily a feeling of 
inadequacy; didn't do 
term paper. 


1^5 


F on attendance, IO/I 6 ; 
in other classes too 


Withdrew September 10 


152 


Home problems; finance 
work, etc 00 


Excessive unexcused 
absences 
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TABLE TV (cont*) 



Total 

of 

Scaled Scores 

1^1 



150 



1U7 

136 



Reason Given 

by 

Counselor 

Personality clash with 
instructor— no initiative 
to drop section or change 

2 3 hr So a week work for 
pay, plus 13 units — too 
much, I/II4 — F because of 
absences . 

Attendance; F in Phy Sci 1 



Lacks emotional maturity 



Reason Given 

by 

Instructor 

Did very little work; no 
term paper; few compo- 
sitions. 

Excessive unexcused 
absences , 



Did very little work; 
no compositions or term 
paper. 

Term paper unacceptable. 



Thia information was given by each counselor to one of the writers 
personally. In no case did the counselor give ’’lack of academic ability” as one 
of the basic reasons he thought the student failed. The information from the 
instructors was collected by a very short questionnaire which asked the instructor 
to check any of the following reasons there was, plus adding any others he desired. 
The reasons listed in order on the questionnaire were: (l) exceeded the unexcused 

absence limit, C 2 ) lacked ability, (3) lacked motivation, (I4) didn’t do required 
term paper, C 5 ) other (describe please). No instructor for ar^ of the students 
who failed indicated "lacked ability” as one of the reasons. 
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k. CONCLUSIONS AND RECOMMENDATIONS 

li.l Derived coefficients 

Since a coefficient of correlation (Pearson product moment) summarizes 
in one numerical measure the degree of relationship existing, its main value for 
the purpose of this study is to provide an index comparison among the Total of 
Scaled Scores and the raw scores of various parts of the Cooperative English Test 
with final semester grades of English 1A-1A71* Because the Vocabulary, Effectiveness, 
and Speed coefficients or correlation are so low as to indicate either no positive 
relationship with final semester grades or a very slight relationship, this study 
presents no evidence to support using those parts of the test for the purpose of 
determining which students shall be permitted or denied the opportunity of 
enrolling in Stockton Collegers English 1A-1A71. Later discussion, therefore, 
will ignore these parts. 

The chi square and phi test indicate that the Mechanics part of the 
Cooperative EngliF!h Test «akes a reasons’ ly good predication of success in 
English 1\-1A?1, Therefore, since these statistical tests (chi square, phi, and 
Pearson inefficient of correlation) indicate that the Mechanics part of the 
Cooperat Lve test is superior to the total test and to any other of its parts 
(except Level, which was eliminated from the study) the writers would judge that 
the score on the Mechanics section should be used, instead of the Total of Scaled 
Scores, to determine a student’s eligibility for English 1A-1A71, Almost as 
important is future use of the derived coefficients to compare efficiency of 
other tests which might be utilized for the same purpose as the Cooperative 
English Test, or a revision of the test, now is used, 

l;,2 In the opinion of the authors, the matter presented graphically supports 
the conclusions derived from the consideration of coefficients. 
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14,3 It is desirable to en^Dh'^’Size here that none of the fourteen who failed 
was described either by the counselor or teacher as one whose failure seemed to 
be caused by lack of ability, 

li.li Since Effectiveness, Vocabulary, and Speed raw scores appear to have little 
pr no value in determining eligibility or predicting probable achievement in 
English 1A-1A71, and since the whole of the Cooperative English Test (Total of 
Scaled Scores) is less effective than one part. Mechanics, the writers recommend 
that consideration should be given to using only the Mechanics part for the 
purpose of selection, 

li,^ At least every two years, follow-up studies of a similar or more precise 
nature should be made to measure progress toward the ideal, 

14,6 The writers suspect that th« 2 e findings may have some relevance for 
similar situations in other junior colleges. 
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SUMMARY 

In order to enroll in the college-transfer English 1A-1A71 freshman compo- 
sition course, a student at Stockton College must earn a Total of Scaled Scores 
of 1^0 on the Cooperative English Test. An analysis was made to discover the 
effectiveness both of the test and of the score of 1^0 in screening entrants to 
this course. The statistical measures used were the Pearson product-moment 
coefficient of correlation along with the chi square and phi tests, comparing 
final semester grades in the English 1A-1A71 course and the scores on the Coop- 
erative English Test. The sample was made up of 2l5 students, all but 17 of 
whom attained at least the score of 1^0 when they took the test as part of the 
entrance battery for the Fall Semester, 19^8. 

The Pearson product-moment coefficients of correlation for the Vocabulary, 
Apeed, and Effectiveness parts of the Cooperative English Tests were so low as 
to indicate a negligible amount of positve relationship. The coefficient of 
correlation for the Total of Scaled Scores was ,31 t ,o6 and for the Mechanics 
part was oUO * .06, Further analysis of the Mechanics part was made by means of 
the chi square and phi testj this analysis indicated that this part might have 
a worthwhile predictive value. 

Graphs were prepared to show visually the relationship between semester 
grades and the rank by groups enrolled in English 1A-1A71 as determined by the 
selection process. Those three groups were: (l) enrolLments in English 1A71 

by special permission C^otal of Scaled Scores of less than l50), (2) regular 
enrollment in English 1A71 (l50-l6li), and (3) enrollment in English lA (above l6ii). 

In addition, some further information was gathered regarding the seventeen 

students who entered English 1A71 by special permission, and of the ones who 

failed either English 1A-1A71. It is interesting and important to note that no 

counselor nor any instructor attributed failure to the student *s lack of ability, 

o 
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6, RESULTANT ACTION 

Beginning with the Fall semester, I960, placement in English 1A-1A71 will 
be on the basis of the Mechanics and Reading parts of the Cooperative English 
Test instead of the Total of Scaled Scares, thus eliminating the Effectiveness 
part. The cutting score, the sum of the scaled scores of the two parts, will be 
a minimum of 100 for eligibility to English 1A71 and 11 $ for English lA, 

It is hoped that a follow-up study can be made soon of the effectiveness of 
the new procedure and of the revised form of the Cooperative English Test, 



